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cles  I rue  t i VC  evaluation  of  nuiterials  for  classifying  ultrasonic  pulse  echo 
waveforms.  Computer  programs  were  developed  to  implement  al<]orilhms  to  qenerat 
power  spectrum,  cepstrum,  and  aulo-cor re  I a I i on  waveforms  from  the  ultrasonic 
pulse  echo  waveforms.  These  algorithms  have  a firm  statistical  foundation  and 
also  have  properties  associated  with  them  that  allow  th?  Fast  Fourier  Transform 
to  be  utilized  in  an  efficient  manner.  Also,  statistical  features  were  extracted 
from  the  waveforms.  The  features  were  then  input  to  pattern  recognition  tech- 
niques in  order  to  classify  the  data  into  appropriate  material  defects.  The 
procedure  outlined  above  was  implemented  with  ^9  ultrasonic  pulse  echo  waveforms 
obtained  from  flat-bottcxn  holes  of  eigiit  different  diametei-s. 

A recognition  accuracy  t.f  has  been  attairiod  wIk  n the  flat-bottom  holes 

are  classified  into  two  categories  using  only  one  feature  from  the  original 
ultrasonic  pulse  echo  waveforms  reflected  from  the  f I a t - l.ol I (mi  holes.  The  same 

J 

results  are  achieved  when  the  one  feature  is  either  the  maxinuim  am|)litude,  the 
root-mean-square  value,  or  the  variance  of  the  waveform.  An  unexfiocted  result 
was  also  observed  when  a time  scries  method  was  applied  to  the  portions  of  the 
ultrasonic  pulse  echo  waveforms  that  were  reflected  from  t lie  backwalls  instead 
of  the  flat-bottom  hol»'s.  lor  tliis  procedure  an  03'  recctgnition  rate  was  achieved. 

This  indicates  that  d i sc r im i na tory  information  is  also  contained  in  the  backwall 
echo . 

SIGNAL  PROCF.SSING  ALGORITHMS 

The  signal  processing  algorithms  considered  are  those  used  to  (lenerate  the 
power  spectrum,  ceiistrum,  and  au  to-cor  re  I a t i on  . Jus  t i f i ca  i ion  for  the  algoiitlm's 
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suggested  is  based  on  statistical  estimation  theory.  The  Fast  Fourier  Transform 
(FFT)  provides  an  efficient  means  of  computint)  the  power  spectrum,  cefistruin,  and 
auto-corre lat ion. 

The  periodogram,  (<<')  . is  most  often  used  in  estimating  the  power  spectrum. 
For  a real  f i n i te- 1 eng th  sequence  x(n),  n = 0,  1,  . . . , N- 1 , the  Fourier 
transform  is 

X (jm)  = ) X (n)e 

n=0 

and  -the  periodogram  is  defined  as 


The  periodogram  is  a biased  estimator  of  the  power  spectrum.  It  is  also  a fact 
that  the  periodogram  is  not  a consistent  estimator  and  therefore  can  be  expected 
to  fluctuate  about  the  true  [lower  spectrum  [n]. 

Two  smoothed  spectrum  estimators  based  on  Bartlett's  procedure  [l3]  and 
Welch's  method  [2l]  arc  proposed.  In  the  Welch  method  a data  sequence  x(n), 
n = 0,  1,  . . . , N- 1 , is  divided  into  K segments  of  H samples  each  so  that  N = KM. 
The  K modified  periodograms  are  defined  as 


I .-!2 

i ^ ^ ~ ttlJ  '■  i ( '' ) w ( n ) e * I , i = 1 , 2,  . . . , K 
n=0 

where 

1 2 
U = M A w (n) 
n=0 


.ind 


x.(n)  = x(n  + in  - M),  n = 0,  1,  . . . , H- 1 , i = 1,  2,  . . . , K. 
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' The  si)ectrol  estimate  is  defined  as  the  average  of  these  modified  per  i odotj  rams , 

r I 

[ 

I 1 ^ 

P(u.)=7  ; 

I i=l  ' 

Some  of  the  commonly  used  windows  are  known  as  the  Rectangular,  Bartlett, 
Hanning,  Hamming,  and  Blackman  windows  [l3j-  If  the  windov/  w(n)  is  chosen  so 
that  w(n)  = 1,  n = 0,  1,  . . . , H- I , (that  is,  the  Rectangular  window)  the 
above  spectral  estimate  P((.iO  becomes  the  estimate  based  on  Bartlett's  procedure. 

Both  Bartlett's  procedure  and  Welch's  method  yield  consistent  estimators, 
although  both  are  biased. 

The  FFT  algorithm  can  be  used  to  advantage  in  computing  the  power  spectrum 
by  any  of  the  above  methods. 

The  Discrete  Fourier  Transform  (DFT)  is  defined  to  be  [l3] 

X(k)  = i k = 0,  I,  . . . , N-1, 

n=0 

for  the  sequence  x(n),  n = 0,  I,  . . . , N-l,  and  the  inverse  Discrete  Fnuiier 

Transforn)  is  given  by 

x(n)  = 1 V ■ 

k=0 

Computationally  efficient  algorithms  that  exploit  both  the  synmetry  and  periodicity 
of  the  sequence  e Iq  compLite  tlic  DFT  are  known  as  FFT  algorithms  [13.'^‘.I5]. 

The  periodocjram  can  he  coHipiited  at  equally  spared  f re(|iienc  i os  by  first 
rompuling  X(k)  using  an  I FI  al<|orittim  and  then  compul  i ng 

i|,j(k)  = i |X(k)  1^,  k = 0,  I , . . . , N'l  . 


The  averaged  per iodogranis  used  for  dart  let t ' s procedure  or  Welch's  Method 
can  be  computed  in  the  following  way.  First  compute 

M-  t 

X.(k)  = ) x.(n)w(n)e  k ~ 0,  1,  . . . , M- 1 

' n=0  ' 

2 

for  each  section  using  an  FFT  algorithm.  Next  |x(k)|  is  computed  for  e.u  h 
section.  These  terms  may  then  be  added  together  for  the  K segments  and  the  results 
divided  by  KMU  to  yield  P(2-ik/M),  k = 0,  I,  . . . , M- 1 . 

The  cepstrum  [l2]  is  defined  as  the  inverse  Fourier  transform  of  the 
logarithm  of  the  power  spectrum.  It  is  useful  in  detecting  periodicities  in  the 
log  spectrum. 

The  auto-correlation  is  usually  found  as  the  inverse  FFT  of  the  power  spectrum. 
This  procedure  is  fast,  but  the  auto-correlation  estimate  can  best  be  found  by 
using  the  FFT  in  computing 

j IJ-m-  1 

c(m)  = — / x(n)x(n+m),  m = 0,  1 , . . . , M-1 

n=0 

where  M < N [13].  This  estimator  is  asymptotically  unbiased. 

FEATURE  EXTRACTION 

Given  a set  of  discrete  time  v/aveforms,  the  power  spectrum,  cepstrum,  and 
auto-correlation  waveforms  can  be  obtained  for  each.  In  order  to  classify  this 
set  of  waveforms  into  categories  with  common  characteristics,  d i sc r i no  na tory 
features  must  be  extracted  from  these  waveforms. 

The  features  computnti  from  the  v/aveforms  are  statistical  in  nature.  They 
are  ktujwn  as  the  mean,  variance',  maximum,  root-mean-sr|u  ire,  skewness,  and 
kurtos i s. 
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Suppose  a waveform  is  denoted  by  g (y)  and  the  probability  density  function 
f (y ) i s g i ven  by 

f(y)  = ^ 5(y-y,)  + ^ 6(y-y2)  + . . • + “ -^(y-y^)- 
With  this  information  the  features  can  be  computed  as 


h = E[g(v)]  = / g(y)f(y)dy  = ^ g(y;), 

i = 1 


N 


= E[{g(Y)-ul^]  = A [g(yj)"V‘l^. 


g(y)„_^  = max  [g(y.)] 


max 


H 


r.m.s.  = {E[g“(Y)]}'’-  = I g^(y.)]'', 

i = 1 


and 


SK=Eilii(^l  =_J_  " h(y, 

Ua^  i=1 


KR 


E[!g(Y)-Ml  ] _ 1 


r-  /,  [g(y.)-ii] 

No  i = 1 


where  u denotes  the  mean,  o denotes  the  variance,  g(y)  denotes  the  maximum, 

max 

r.m.s.  denotes  the  root-mean-square,  SK  denotes  the  skewness,  and  KR  denotes  the 
kurtosis  [19]. 

The  next  section  describes  how  these  features  may  be  used  to  classify  the 
v/aveforms . 

PATTERN  RECOGNITION 

Automated  interpretation  of  ultrasonic  pulse  echo  waveforms  can  be  formulated 
as  a classification  problem  in  which  it  is  desired  to  decide  into  which  of  T 
categories  denoted  by  C ^ . . . . , C.J.,  each  test  block  belongs.  The  numerical 
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results  from  preprocessing  time  waveforms  for  each  test  block  can  be  represented 
by  a point  in  m-d  imens  iona  I space  assuming  that  rc-sults  consi'.t  of  m measurements 
or  features. 

A pattern  is  an  m-tuple  where  each  component  represents  a measurement  or 
feature.  A pattern  is  denoted  by  the  vector  Y where  Y = (y^  . . . . , y^  ) . 

Let  r'^  denote  the  set  of  all  m-tuples  (y^  , . . . . , y^)  whose  components 

y^ y^^i  are  real  numbers.  r"'  is  called  m-space,  arid  each  m-tuple  in  r'^ 

is  said  to  be  a point  or  vector  in  m-space. 

The  topic  of  classification  is  usually  included  under  the  more  ((cneral  topic 
of  pattern  recognition.  Several  good  survey  papers  [5,7,10,20]  and  rccr'nlly 
published  books  [l,3,l8]  have  been  written  describing  pattern  recognition 
techniques. 

In  most  pattern  recognition  problems  the  only  information  available  consists 
of  a "training"  set  of  L patterns  vrhose  true  classifications  are  known.  The  L 
patterns  denoted  by  Y j ,....,  Y^^  are  called  trainiruj  samples.  The  training 
samples  from  each  category  are  assupied  to  be  independen'.  and  identically  <iis- 
tributed  according  to  some  unknown  defisity  function.  The  training  samples  are 
used  to  construct  decision  rules  which  arc  implemented  by  d i sc r i mi n.m t functions. 
These  functions  are  defined  to  be  real-valued  functions  of  the  pattern  Y used  in 
classifying  pattern  Y as  a member  of  one  of  the  T categories.  The  discriminant 
functions  yield  a decision  rule  vjhich  specifies  that  pattern  Y is  classified  as 
being  a member  of  that  class  which  has  the  largest  discriminant  function  value. 
Sample  and  Feat ure  S i /e 

In  most  pattern  recognition  (ircd/lc-ms  lillli-  is  known  nlioul  I he  underlyinii 
probability  distributions  of  the  T categories  or  classes.  Thei'cfore,  the  dis- 
criminant functions  must  be  determined  on  the  basis  of  the  L training  samples. 


The  classification  results  obtained  from  the  traininc)  samples  should  be  related 
to  the  performance  of  the  decision  rule  on  future  samples.  Quite  often  the  error 
rate  obtained  is  lower  than  the  true  erior  rate  of  t lie  classifier. 

One  method  quite  often  used  to  estirrale  the-  true  error  rate  of  a classifier 
is  to  divide  the  original  L 5.)"ii>les  into  a design  set  and  a test  set.  The  design 
set  is  then  used  as  the  training  set  and  the  resulting  disci iminant  functions  arc- 
then  tested  on  the  tost  set.  One  problem  v/ith  this  ap()roach  is  that  the  value  of 
L may  be  small  and  a better  classifier  could  be  designed  by  using  all  of  the 
samp  I cs . 

Based  on  a fixed  sample  size  Kanal  and  Chandrasekaran  [6]  recommend  using  the 
" 1 eav i n<)-one-ou t"  method  in  designing  a classification  system  and  evaluating  its 
performance.  In  the  leaving-one-out  method  a classifier  is  designed  based  on 
L- 1 samples  and  then  tested  on  the  one  removed  sample.  This  procedure  is  repea' ed 
for  each  of  the  L training  samples.  A problem  associated  with  ttiis  approach  is 
that  it  may  be  too  time  consuming. 

Foley  [2]  using  both  experimental  and  theoretical  results,  indicates  that  the 
ratio  of  the  number  of  samples  per  class  to  the  number  of  features  siwuld  be  at 
least  three  to  obtain  good  estimates  of  the  oiUimum  error  rate.  That  is, 

> 3,  (I) 

m 

where  represents  the  number  of  samples  per  class. 

Meisel  [8]  points  out  that  the  m used  in  equation  (1)  should  in  s<x.  sense  be 
the  "intrinsic  d imen-.;  i ona  1 i I y"  . This  mean-,  lhal  t lu-  set  ol  m featuri-s  should 
contain  only  relevant  information.  Feature  seU-tlion  schemes  [/,8,l8j  might  he 
used  in  reducing  m-space  to  one  that  contains  only  use''ul  discriminatory  information. 
Kanal  [7]  d iscusses  other  investigations  into  dimensionality,  sample  size,  and 
error  estimation. 
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When  a classifier's  performance  cannejt  be  yeneralized  to  future  unknown 
samples  the  classifier  is  said  to  be  overtrained  or  overfitted.  This  situation 
occurs  most  frequently  when  the  number  of  samples  per  class  is  small  compared 
to  the  number  of  features. 

Perceptron  Algorithm 

A class  of  machines  developed  as  a model  of  machine  learninq  and  decision 
making  has  been  called  a perceptron  and  has  played  an  important  role  in  the 
development  of  pattern  recognition  theory  [l,l6,17j- 

The  basic  perceptron  algorithm  is  a simple  scheme  for  the  iterative  deter- 
mination of  the  weight  vector  W used  to  define  the  hyperplane  d(Y)  = W«Y  = 0, 
which  is  a linear  discriminant  function.  An  outline  of  the  perceptron  algorithm 
can  be  stated  as  follows. 

Given  two  sets  of  training  samples  belonging  to  pattern  classes  and  C2, 
respectively,  let  the  initial  weight  vcctcjr  be  chosen  arbitrarily.  Then, 
the  (k+l)st  approximation  is  given  by: 

1.  If  the  kth  member  of  the  training  ■ cquenco  Y^  is  classified  correctly 
leave  the  weight  vector  unchanged.  That  is. 


Vi 

II 

if  W^.Y^>0 

and 

YkCC 

Vi 

= ^ 

0 

V 

>- 

w,- 

and 

2.  Otherwise,  the  weight  vector  is  changed  by 
Vi  = 0 and  Y^cC, 

or 

W,  u.  = W,  -cY,  if  W -Y.  :•  0 and  Y,  , 
k 1 1 k !•;  k k k ? 

where  c is  a positive  correction  increment,  possibly  depending  u|Kin  k. 

The  algorithm  is  said  t(t  have  converged  when  all  of  the  training  samples 

are  classified  correctly.  It  can  be  shown  that  If  the  two  classes  are  linearly 
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separable  then  the  perceptron  algorithm  converges  in  a finite  mimher  of 
iterations  [l,ll,l8].  The  correction  increment  c may  be  si'lected  in  sevinal 
ways  although  in  practice  a value  of  c = 1 works  quite  well. 

Linear  Prediction 

Linear  prediction  is  becoming  increasingly  important  in  sicpial  proces- 
sing because  of  the  accuracy  witli  which  it  forecasts  time  series  data  and  the 
speed  of  computation  of  its  coefficients.  The  linear  predictor  coefficients 
and  the  auto-correlation  values  can  be  used  as  features  in  classify  itig  wave- 
forms. This  technique  has  been  particularly  successful  in  speech  recognition 


Linear  prediction  requires  the  waveform  to  be  stationary.  By  dividing 
the  waveform  into  a sufficient  number  of  windows,  each  window  can  be  assumed  to 
be  stationary.  Over  each  window  the  waveform  can  be  modeled  as  an  autoregressive 
process  of  order  p (AR(p)  process);  that  is,  it  is  assumeci  that  each  sampled 
value  Zj,  can  be  represented  by  the  past  p values,  plus  a ^ero-niean  noise  term  a^: 


z,  = + . . . + + a^. 

The  waveform  is  tlius  described  over  each  window  by  the  parameters  ^ . . 

The  least  squares  estimate  of  these  terms  can  be  obtained  by  solving  the  Yule- 


Walker  equations 


k = I , 2,  . . . , p 


by  replacing  the  true  auto-correlation  coefficients  n.  fiy  c.  , their  calculated 

k k 

nstimales  [!(].  The  leasl  squar('S  esl  iiii,it(;  <|)  of  j = (■;  j,  . . . , is  a 

maximum  log  likelihood  cstiniate  of  the  parameter  ! and  a distance-  measure  (if  the 


P P 

'og  ( )^  I )'. 

k=1  i=l 


i-k|  ' “^k' 
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was  considered,  since  titis  distance  measure  qave  excellent  resulls  in  spcecli 
recognition  [4].  (This  expression  does  not  refiresent  a true  rubric,  and  thus 
it  is  actually  a similarity  measure  instead  of  a distance  measure).  The  Ij 
<ire  the  estimated  linear  predictor  coefficients  of  the  reference  or  training 
sample  while  the  C|^  are  the  auto-corre  1 Tt  i on  coefficients  of  the  unknov/n  or 
test  sample.  The  total  distance  between  a test  sample  and  a training  samfjle  is 
the  s>um  of  (2)  over  all  windovjs  of  the  sample.  The  test  san()le  is  then  classified 
as  being  a member  of  the  sarr;e  class  as  the  training  sample  sdiich  gives  the 
minimum  distance  to  the  unknown  test  sample.  Hence  the  classification  technique 
used  for  this  procedure  is  the  Mcarest  Neighbor  decision  rule  [l]. 

RESULTS 

The  Air  Force  Materials  Laboratory  initiated  a pro''iram  to  determine  if  an 
advanced  signal  processing  system  could  classify  the  ultrasonic  pulse  echo  vjave- 
forms  from  flat"bottom  holes.  This  study  examined  fortyninc  samples  obtained 
from  aluminum  area-amplitude  test  blocks  and  three  different  transducers  [9]. 

Sixteen  test  blocks  V/cre  fabricated  from  tvjo  different  sets  of  7075-T6 
aluminum  alloy.  Each  of  the  two  sets  contained  eight  test  blocks  which  had  flat- 
bottom  hole  sizes  ranging  in  diameter  from  ]/Gk  to  8/6A  inches  in  iricrements  of 
1 764- i nch . 

The  three  transducers  used  in  this  study  were  all  5 MHz  transducers  ivith 
diameters  of  0.5,  0.75,  and  1.0  inch. 

The  received  ultrasonic  pulse  echo  waveforms  vtcre  sampled  at  100  MHz  and  the 
resulting  digitized  time  waveforms  were  obtained.  The  forty-nine  samples  for  the 
eight  categories  were  divided  into  a Ir. lining  sel  .md  a lesliiKi  sei  consisting  of 
31  and  18  samples,  respectively.  1 he  cl.iss  distribution  ol  (sic  li  class  is  ■■  i ven 
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in  Table  I . 


TABLE  I 


DISTRIBUTION  OF  THE  TRAIN  I NO  AND  TESTING  SET  FOR 
THE  FLAT-BOTTOM  HOLE  DATA 


Class 

(Ho  1 e Si zes  in  6At h ' s ) 

Number  of 
Training  Samples 

Number  of 
Test! ng  Samp  1 es 

1 

It 

2 

2 

l| 

2 

3 

2 

2 

It 

l| 

2 

5 

4 

2 

6 

4 

2 

7 

4 

3 

8 

5 

3 

TOTAL  31 

18 

Before  applying  the  signal  processing  algorithms  and  feature  extraction 
techniques  it  i s of  interest  to  consider  the  relationship  between  the  number  of 
samples  available  for  processing  and  the  number  of  features  used  for  classification. 

The  basic  perceptron  algorithm  described  earlier  is  based  on  the  two  class 
problem,  although  it  is  easily  extended  to  the  multiclass  situation  [18]. 

For  the  T class  problem  the  idea  is  to  determine  T linear  discriminant  functions 
d,(Y) d.|.(Y).  with  the  pro[ierty  that  if  Y rC.,  then 

d.(Y)>d(Y)forallk?^i.  (3) 

I K 

When  all  ol  the  training  samples  are  clas,itied  correctly  by  (3)  the  T classes 
arc  said  to  be  linearly  separable. 

It  i s we  I 1 knov/n  [II]  that  if  L < m + I then  there  exists  a linear  discriminant 
function  which  effects  the  same  d i chotomi zat ion  as  specified  by  the  two  class 
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issiijnment  of  the  L points.  This  situation  demonstrates  ttiat  <jver  t ra  i n i iu|  nav 
occur  when  L < ni  + 1 since  a separator  does  exist  that  will  d i chol  <x>i  i the 
samples  correctly,  althou()h  it  may  not  he  the  optimal  clas'  iHer.  This  fact 
may  also  be  demonstrated  by  the  use  of  tite  perceplron  alc]orittim  [l8]. 

From  Table  I it  can  be  seen  that  the  two  smallest  classes  contain  a total 
of  and  6 samples,  respectively.  This  implies  that  L has  a value  of  10.  The 
argument  above  indicates  that  m must  have  a value  less  than  9 to  be  sure  that 
these  two  classes  are  not  forced  to  be  linearly  separable.  When  the  same 
argument  is  applied  to  only  the  training  samples,  it  is  seen  that  m must  have  a 
value  less  than  5 in  order  to  avoid  the  forced  linear  separabi I i ty.  Hence,  the 
number  of  features  extracted  from  the  waveforms  that  arc  to  be  used  for  clas- 
sification must  be  less  than  5-  This  number  is  still  marginal  since  the  ratio 
of  the  number  of  training  samples  per  class,  which  varies  from  2 to  5,  to  the 
number  of  features  is  less  than  1.25  for  each  class  when  m is  equal  to  It.  This 
ratio  should  be  much  higher  as  indicated  earlier  of  the  performance  of  a clas- 
sifier is  to  be  generalized  to  unknov/n  samples. 

The  overall  problem  can  be  reformulated  into  a more  satisfactory  problem 
in  terms  of  the  relationship  between  the  number  of  samples  and  the  nutnber  of 
features.  In  order  to  accomplish  this  two  separate  cases  were  considered  to 
reduce  this  to  a two-class  problem.  First,  classes  1,  2,  3,  and  k can  be 
grouped  together  as  a single  category  and  classes  5,  6,  7,  and  8 can  also  be 
grouped  together  as  a single  category.  Second,  classes  1,  2,  and  3 can  be  con- 
sidered as  one  category  and  classes  k,  5,  6,  7,  and  8 can  be  considered  as  a 
second  category. 

In  applying  the  signal  processing  algorithms  to  tlie  rellc'ctcd  ultrasonic 
pulse  echo  waveforms  and  classifyitig  the  samples  based  on  the  extracted  features. 
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it  was  found  that  the  cepstrum  and  the  auto-correlation  waveforms  contained 


little  discriminatory  information.  Therefore,  the  followiri(|  discussion  will 
center  on  the  original  waveforms  and  the  power  spectrum  waveforms. 

Figure  1 shows  one  of  the  reflected  ultrasonic  pulse  echo  waveforms  from 
a test  block  with  a hole  diameter  of  8/61*  inches.  A plot  of  the  pertinent  pulse 
echo  defect  data  is  shown  in  Figure  2.  This  is  actually  a magnified  picture 
of  the  first  portion  of  the  waveform  shown  in  Figure  i.  Figures  3'7  show  the 
power  spectrum  of  Figure  2 based  on  the  different  algorithms  discussed  earlier. 
It  should  be  apparent  from  Figures  3 and  4 that  Bartlett's  procedure  with  one 
window  yields  the  periodogram.  Figure  8 e.xhibits  a plot  of  the  pulse  echo  data 
that  traveled  past  the  defect  and  was  reflected  by  the  surrounding  backv/a I I . 
Actually,  this  is  a magnified  picture  of  Llie  second  portion  of  the  v/aveform 
shown  in  Figure  1.  Figures  3-12  show  the  power  spectrum  of  Figure  8 based  on 
Bartlett's  procedure  and  Welch's  method. 

It  should  be  noted  that  each  of  the  49  pulse  echo  waveforms  v/ere  corrected, 
before  any  processing  was  perfonned,  for  the  three  instruments  settings  of 
sensitivity,  attenuation,  and  damping.  These  settirufs  were  varied  as  the  data 
were  recorded  [9]-  The  corrected  waveforms  will  be  referred  to  as  the  original 
waveforms  in  the  following  discussion. 

Table  II  shows  the  distribution  of  training  samples  and  testing  samples  for 
case  1 in  which  classes  1,  2,  3.  and  4 are  grouped  together  as  one  category  and 
classes  5.  6,  7,  and  8 are  grouped  together  as  a second  category.  Table  III 
exhibits  the  same  information  for  case  2 in  which  catenory  one  is  composed  of 
classes  1,  2,  atul.  3 and  calet|f)ry  two  is  composed  o(  ( lasses  h,  f, , 6,  /.  and  8. 

The  classification  (iroblem  for  both  of  those'  case,  appears  to  be  more 
realistic  in  terms  of  the  earlier  discussiotis  c>n  tlie  t a- 1 a t i onsti  i ps  between  the 
number  of  samples  and  the  number  of  features.  Both  c<i  .es  can  be  thought  of  as 
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tlirfshoMin<|  ,)robiems  where  the  thresholds  are  equal  to  ^t-5/6A  and  3-5/64  inches 
for  case  1 and  case  2,  respectively. 


TABLE  I 


TWO  CATEGORIES  OF  FLAT-BOTTOM  HOLE  DATA 


(CASE 


Cateqory 


Humber  of 
Training  Samples 


Number  of 
Testing  Samples 


TABLE 


TWO  CATEGORIES  OF  FLAT-BOTTOM  HOLE  DATA 


(CASE  2) 


Categor 


Nuiiber  of 
Training  Samples 


Number  of 
Testing  Samnles 


TOTAL 


For  Case  1,  both  the  maximum  ampliludi'  and  r.m.s.  fcMtures  of  the 
original  v;aveforms  were  lound  to  correct  ly  classil  / h(i  ol  the  samples.  1 he 
Nearest  Neighbor  decision  rule  yielded  the  same  results  using  maximum  amplitude, 
mean,  variance,  and  r.m.s.  as  features.  The  mean  of  the  power  spectrum  correctly 


classified  samples  using  Welch's  method  with  t v/o  windows.  When  Bartlett's 
procedure  with  two  windows  was  used  to  calculate  the  power  spectrum,  the  r.m.s. 
correctly  classified  45  samples. 

For  Case  2,  the  maximum  amplitude,  r.m.s.  and  variance  of  the  original 
waveform  were  found  to  individually  classify  48  of  the  49  samples  correctly. 

The  same  results  were  obtained  when  these  three  features  were  collectively  used 
in  3"space.  The  Nearest  Neighbor  rule  correctly  classified  47  sa;i)ples  using 
maximum  amplitude,  mean,  variance,  and  r.m.s  as  features.  The  mean  of  the  power 
spectrum  correctly  classified  48  samples  using  two  windows  for  both  Bartlett's 
procedure  and  Welch's  method. 

The  results  above  were  based  on  the  portion  of  the  waveform  that  was 
reflected  from  the  flat-bottom  holes.  Also,  the  perceptron  algorithm  vras  used 
to  obtain  linear  discriminant  functions  when  no  classification  procedure  was 
mentioned.  The  features  skewness  and  kurtosis  were  found  to  contain  no  dis- 
criminatory information  when  used  for  any  of  the  waveforms. 

For  Case  2,  another  portion  of  the  original  wavefornrs  v;as  also  analyzed. 

When  the  portions  of  the  pulse  echo  vyaveforrns  that  traveled  past  the  defect  and 
were  reflected  by  the  surrounding  backwall  were  analyzed  by  the  linear  prediction 
technique,  43  samples  were  correctly  classified.  For  this  procedure  p had  a 
value  of  10  and  6 v/indov;s  were  used.  Also,  the  number  of  training  samples  was 
24  and  the  number  of  testing  samples  was  25. 

CONCLUSIONS 

It  has  been  shown  (hat  with  a small  sample  size  pattern  recognition  and 
sigtial  processing  t echn  i i.in  he  used  eflectivly  in  class!  fyirui  ii  I I i sison  i ( 

l>ulsc  echo  waveforms  for  the  nondestructive  evaluation  of  materials.  The  s.imple 
size  should  be  larger  though  in  order  to  make  the  results  s ta t i s t i ca 1 1 y signi- 
ficant. One  way  that  this  could  be  achieved  would  be  to  shoot  each  test  block 
several  times  with  each  transducer. 
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The  techniques  and  procedures  discussed  in  this  report  can  be  use<l  lo 
process  other  nondestructive  evaluation  data.  The  fatigue-crack  data  tliat 
was  to  be  processed  has  never  been  received.  The  computer  programs  that  were 
used  have  been  delivered  to  the  Nondestructive  Evaluation  Branch  (AFML/LLP) 
at  Wr ight-Patterson  Air  Force  Base. 

The  author  of  this  report  and  the  project  monitor  took  a trip  to  the 
Rome  Air  Development  Center  (RADC)  at  Griffiss  Air  Force  Base  to  visit  with 
personnel  concerning  the  use  of  RADC ' s interactive  pattern  recognition  facility 
OLPARS.  This  facility  has  excellent  waveform  processing,  feature  extraction, 
and  pattern  recognition  techniques  available.  It  allows  the  researcher  who 

r 

understands  the  physicaf  problems  to  insert  his  knowledge  into  the  solution  by 
interaction  at  a CRT  display.  Another  trip  was  taken  to  Wr i gh t- Pa t terson  Air 
Force  Base  and  the  facilities  at  RADC  were  discussed  v/ith  the  personnel  of 
AFML/LLP.  It  was  pointed  out  to  them  that  they  could  utilize  the  facility  with 
a CRT  via  telephone  lines. 

This  project  has  enabled  the  principal  investigator  to  ct>ncentrate  in  an 
area  in  whict)  he  is  very  interested.  It  has  also  served  as  a research  area  for 
one  M.S.  report  (in  progress).  A paper  is  being  planned  to  be  submitted  to  the 
1978  IEEE  SoutheastCon  to  be  held  in  Atlanta,  Georgia,  in  April  1978.  Furthermore, 
it  has  inspired  a general  interest  in  the  areas  of  pattern  recognition  and  digital 
signal  processing  in  numerous  faculty  and  graduate  students  in  the  Electrical 
and  Computer  Engineering  Department  at  Clemson  University.  For  all  of  the  above 
reasons,  we  are  grateful  to  the  Air  Force  Office  of  Scientific  Research  for  making 
this  project  ()ossiblc. 
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20).  Abstract  - continued 

to  classify  the  data  into  appropriate  material  defects  statistical  features  were 
extracted  from  the  original  and  generated  waveforms.  The  features  were  then 
used  as  input  to  pattern  recognition  techniques. 

Using  only  one  feature  from  the  original  ultrasonic  pulse  echo  waveforms, 

1*8  of  kS  samples  were  dichotomized  correctly  for  a recognition  rate  of  98%-  The 
one  feature  can  be  either  the  maximum  amplitude  or  the  root-mean-square  value 
or  the  variance  of  the  waveform,  since  all  yielded  the  same  results.  It  was 
also  discovered  that  43  of  the  49  samples  were  dichotomized  correctly  when  a 
time  series  method  was  applied  to  the  portions  of  the  pulse  echo  waveforms  that 
traveled  past  the  defect  and  were  reflected  by  the  surrounding  backwall.  This 
indicates  that  the  backwall  echo  also  contains  discriminatory  information. 


